VOtus: A Flexible And Scalable Monitoring Framework for Virtualized Clusters

Large-scale distributed processing frameworks such as Hadoop are currently enjoying wide popularity for big data computation. Performance Analysis and monitoring under these frameworks are inherently difficult especially in a virtualized environment. Existing distributed monitoring tools can only report virtual resource usage. Such reported information might be insufficient for developers and users to acquire deep insights into the performance of distributed applications. This paper describes VOtus, an initial step towards extending the Otus monitoring tool for virtualized clusters on private clouds. By collecting supplementary metrics from the hypervisor (when available), VOtus allows users to effectively and efficiently monitor a virtualized cluster. It also provides enhanced comprehension of distributed applications, which helps in answering performance related queries that relate to capacity planning, placement, and migration of virtual machines on the cluster.